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ABSTRACT 



A method and apparatus for coupling a plurality of channels 
of a communications network to a node. The node includes 
a plurality of ports, each adapted for connection to a 
corresponding channel and a system interface adapted for 
connection to a plurality of node clients in the form of host 
computers, peripheral devices, network interfaces, etc. The 
node includes a receiver and transmitter dedicated to each 
port and common circuitry for controlling and processing 
frames received and/or transmitted by the plurality of ports. 
A frame prioritization circuit forwards frames received by a 
selected port to a frame handler for processing and a frame 
routing circuit routes frames processed by the frame handler 
to at least one of the ports associated with at least one 
destination node. The node further includes a frame header 
buffer associated with each port for temporarily storing the 
header of each frame received by the respective port prior to 
forwarding of the header to the frame handler. 
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METHOD AND APPARATUS FOR 
REORDERING FRAMES 

This application is a continuation of application Ser. No. 
08/433,086, filed May 3, 1995 entitled: DYNAMIC NODE 5 
SHARING APPARATUS AND TECHNIQUES which is a 
continuation-in-part application of U.S. Sen No, 08/363, 
392, filed Dec. 22, 1994 entitled: METHOD AND APPA- 
RATUS FOR REORDERING FRAMES. 

FIELD OF THE INVENTION 10 

This invention relates generally to communications net- 
works and more particularly, to apparatus and techniques for 
processing frames at a node having a plurality of ports. 



BACKGROUND OF THE INVENTION 



IS 



Switch networks, or fabrics, for transmitting packets 
between two or more nodes are known. Typically, a packet, 
sometimes referred to alternatively as a sequence, includes 
multiple frames, with each frame including a header and a 20 
payload, such as data. Switch fabrics include a plurality of 
switches arranged to permit transmission of frames over 
different paths, or channels. Each node has a port adapted for 
connection to a respective channel. One illustrative type of 
switch fabric is Fibre Channel, in which the nodes connected 25 
to the fabric are referred to as N_Ports. 

Elustrative nodes are connected to various types of sys- 
tems or node clients, such as work stations, data storage 
devices, or arrays, and network interfaces. A network inter- 
face node client is adapted for connection to a network, such 30 
as a local area network, thereby permitting communication 
between other nodes connected to the switch fabric and 
nodes connected to the network. Although generally a node 
is capable of both transmitting and receiving packets, in the 
transmission of a given packet, the node transmitting the 35 
packet is referred to hereinafter as the transmitting, or source 
node and the node receiving the packet is referred to 
hereinafter as the receiving, or destination node. 

Each node includes circuitry for receiving frames from a 
source node over the respective channel, processing 
received frames, and transmitting processed frames to one or 
more destination nodes over the respective channel. Thus, 
each node has dedicated frame receiving, processing, and 
transmitting circuitry associated therewith. 45 

Various techniques are employed for optimizing transmis- 
sion of frames through a fabric in order to minimize con- 
gestion on a particular path and thus, to reduce transmission 
time. However, such transmission optimization may result in 
frames of a given packet arriving at the destination node in 50 
an order different from the order in which the frames are, 
arranged in the packet prior to transmission. 

One technique for reordering frames received at a node 
out of order is to generate and store a memory entry 
corresponding to each of the received frames, including a 55 
"sequence count" identifying the sequential position of the 
frame within its associated packet Once all of the frames of 
a packet are received, a processor executes a program to sort 
the memory entries by sequence count However, since the 
memory includes as many entries as there are frames in the 60 
packet, this technique tends to be inefficient in terms of both 
memory requirement for storing the entries and processing 
time for sorting the entries. 

SUMMARY OF THE INVENTION 

65 

In accordance with the invention, a receive node is 
provided with a port for reordering frames of a packet 



received at the port out of order in a manner that requires less 
memory space and processing time than heretofore required. 
Note that in the case where a node has only one port 
associated therewith, the terms '*node" and "port" are used , 
interchangeably. The port includes a frame manager which 
receives frames and generates a reassembly table in an 
associated memory including only entries corresponding to 
frames received out of sequential order with respect to a 
previously received frame (and a last entry indicating that 
the last frame of the respective packet has been received). In 
one embodiment, each such memory entry includes a 
sequence count, identifying the previously received frame, a 
pointer to a location in memory at which data associated 
with a set of one or more previously, consecutively received 
frames are stored, and a data length value representing the 
length of data associated with the set of frames. 

The reassembly, table entries are processed to reorder the 
frames of the received packet More particularly, the port is 
in communication with a system which includes a processor 
for processing entries of the reassembly table in ascending 
sequence count order to reorder the packet frames. Illustra- 
tive systems include a host computer, a disk array, and a 
network. 

In one embodiment, the receiving node processes frames 
of multiple packets simultaneously and the frame manager 
generates multiple reassembly tables, each one correspond- 
ing to a processed packet. To this end, a context is stored for 
each processed packet and includes fields used to generate 
memory entries for non-consecutively received frames of 
the respective packet 

A method for reordering a plurality of frames of a packet 
received by a node in non-consecutive order includes the 
steps of receiving a frame, comparing the sequence count of 
the received frame to a stored sequence count, and providing 
an entry in memory if the sequence count of the received 
frame is not equal to the stored sequence count. The stored 
sequence count corresponds to the sequence count* of a 
previously received frame incremented by one, or to an 
initialized value when the received frame is the first frame 
to be received. The method may further include the steps of 
maintaining a value representative of a length of data 
associated with a set of one or more prior consecutively 
received frames and providing the data length value in the 
memory entry. A pointer may also be provided in the 
memory entry to a location in memory at which data 
associated with the set of prior consecutively received 
frames are stored. The number of frames received for a given 
packet are counted and the reordering method is terminated 
when the number of counted frames is equal to the number 
of frames in the given packet. 

With this arrangement, a port of a receiving node gener- 
ates a reassembly table which permits packet frames to be 
reordered without requiring significant memory space and 
without imposing significant processing delays heretofore 
associated with frame reordering. These efficiencies are 
achieved by generating a reassembly table containing only 
entries indicating non-consecutive breaks of received 
frames, as opposed to storing entries for each received 
frame. Since the reassembly table contains fewer entries 
than received frames, and fewer entries than conventional 
reordering techniques, the memory requirement is reduced 
and the time associated with processing the memory entries 
to reassemble the packet is reduced. 

In accordance with a further embodiment of the invention, 
a shared node is provided with multiple ports adapted for 
connection to channels of a switch fabric. In the case where 



03/24/2004, EAST 



Version: 1.4.1 



5,619 

3 

the shared node has a plurality of ports associated therewith, 
the term "node" refers to the entire switch fabric intercon- 
nection circuit whereas, the term "port" refers to the portion 
of the node used to connect the node to a particular channel 
of the switch fabric. Each port of the shared node is capable 5 
of both receiving and transmitting frames from and to the 
channel respectively and has a frame header buffer associ- 
ated therewith for temporarily storing the header of frames 
received by the port, A plurality of node client systems are 
connected to the shared node via a bus, with each such node 
client logically associated with a particular channel. Dlus- 
trative node client systems include host computers, data 
storage devices and network interfaces. The shared node 
includes a frame prioritization circuit, or multiplexer, for 
selecting frames received by the ports for forwarding to a 
frame handler for processing. Also provided is a frame 15 
routing circuit, or demultiplexer, for routing frames pro- 
cessed by the frame handler to at least one of the ports for 
transmission to one or more destination nodes. 

With this arrangement, a common shared portion of node 
circuitry is provided for receiving, processing, and trans- 20 
mitting frames associated with a plurality of network chan- 
nels. In this way, the cost of providing a node is reduced, 
since frame processing circuit duplication for each channel 
is avoided. Moreover, utilization of shared resources, such 
as local memory, by multiple ports, serves to efficiently 25 
distribute the cost of such resources among the ports. Also, 
the circuit board area occupied by each node is reduced by 
sharing circuitry among multiple ports. 

The frame prioritization circuit selects received frames for 3Q 
forwarding to the frame handler in accordance with one of 
several prioritization schemes. In one .embodiment, the 
frame prioritization circuit selects frames in accordance with 
a priority assigned to each port at system initialization. The 
preassigned port priority may be based on various criteria, 35 
such as expected frame traffic over a particular channel or 
the type of node client associated with a particular channel. 
In another embodiment, the frame prioritization circuit 
selects frames for forwarding to the frame handler based on 
a predetermined order of the ports, such as a "round robin" ^ 
sequence of the ports or based on the order in which the ports 
receive frames. Alternatively, and in accordance with an 
adaptive scheme for selecting frames for forwarding to the 
frame handler, the frame prioritization circuit determines 
how many frame headers are stored in the frame header 45 
buffer associated with each port and forwards frames based 
on which port has the most frame headers stored in the 
respective frame header buffer. 

The frame prioritization scheme can be tailored to permit 
manipulation of the operating parameters specified by each 50 
node to every other node at system initialization. More 
particularly, although the frame header buffer associated 
with each port has a fixed size, the "credit" (i.e. frame 
receiving capacity specified to other nodes) can indicate that 
greater than actual buffer capacity is available for receiving 55 
frames when the frame prioritization scheme is tailored to 
ensure that the frames received at that particular port are 
rapidly forwarded to the frame handler. With this arrange- 
ment, a port can be permitted to accommodate a higher 
frame traffic level than otherwise permissible by tailoring 60 
the frame prioritization scheme to provide the port with a 
higher rate of forwarding frames to the frame handler. Thus, 
use of the shared node permits frame traffic allocation 
among the multiple channels serviced by the node, thereby 
permitting optimization of node performance. 65 

The frame routing circuit includes a control circuit for 
determining a destination node specified in a processed 



,497 

4 

frame and a look-up table. The table includes a list of known 
nodes connected to the switch fabric and an associated port 
of the shared node in communication with each listed node. 
In operation, the control circuit accesses the table to locate 
the destination node specified in the processed frame, reads 
the identifier of the port associated with the destination node, 
and routes the frame to the corresponding port for transmis- 
sion to the destination node. 

Also described is a method for processing frames received 
by a receive port, including the steps of receiving frames at 
a plurality of ports from a corresponding plurality of chan- 
nels, with the ports being capable of receiving frames 
substantially simultaneously with respect to one another, 
selecting a frame received by one of the ports for processing 
by a frame handler, forwarding the selected frame to the 
frame handler and routing the processed frame to a selected 
port associated with a destination node. In one embodiment, 
the frame selecting step includes determining a priority 
assigned to the ports and selecting frames in accordance 
with a descending order of port priority. In an adaptive frame 
selection embodiment, the frame selecting step includes 
selecting frames in accordance with the number of frames 
received by each port. Hie frame routing step includes 
determining the identity of a destination node specified in a 
processed frame, accessing a look-up table to determine a 
port associated with the determined destination node, and 
routing the processed frame to the port associated with the 
destination node. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The above and further advantages of this invention may 
be better understood by referring to the following descrip- 
tion taken in conjunction with the accompanying drawings, 
in which: 

FIG. 1 is a diagram of an illustrative switch fabric 
interconnecting a plurality of nodes having ports in accor- 
dance with the invention; 

FIG. 2A shows an illustrative frame format for transmis- 
sion over the switch fabric of FIG. 1; 

FIG. 2B shows an illustrative format of a header associ- 
ated with the frames of FIG. 2A; 

FIG. 3 is a block diagram of an illustrative port of FIG. 1; 

FIG. 4 is a block diagram of the Receive Frame Manager 
of FIG, 3; 

FIG. 5 shows an illustrative format of a reassembly table 
in accordance with the invention; 

FIGS. 6 A and 6B show a flow chart of an Olustrative 
process by which the port of FIG. 3 reorders frames; 

FIG. 7A shows an illustrative packet transmitted by a 
transmitting node of FIG. 1; 

FIG. 7B shows one illustrative order in which the frames 
of the packet of FIG. 7A are received by a receiving node; 

FIG. 7C shows another illustrative order in which the 
frames of the packet of FIG. 7A are received by a receiving 
node; 

FIG. 8 shows an illustrative portion of system memory 
allocated to store the received frames of FIG. 7B; 

FIG. 9 shows a reassembly table containing entries asso- 
ciated with the received frames of FIG. 7B; 

FIG. 10 shows an illustrative portion of system memory 
allocated to store the received frames of FIG. 7C; and 

FIG. 11 shows a reassembly table containing entries 
associated with the received frames of FIG. 7C; 
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FIG. 12 is a diagram of a switch fabric interconnecting a 
plurality of nodes in accordance with a further embodiment 
of the invention; 

FIG. 13 is a block diagram of the shared node of FIG. 12; 

FIGS. 14 and 14A are a detailed block diagram of the 5 
shared node of FIG. 12; 

FIG. 15 is a diagram of the frame prioritization circuit of 
the shared node of FIGS. 12^14A; and 

FIG. 16 is a diagram of the frame routing circuit of the io 
shared node of FIGS. 12-14A. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

Referring to FIG. 1, a switch fabric 10, including a 15 
plurality of switches 12, 14, 16, 18, and 20, interconnects a 
plurality of nodes 22, 24, 26. The switches 12-20 are 
arranged to permit transmission of packets, frame by frame, 
between the nodes 22-26 over a plurality of paths 28, 30* 
and 32. More particularly, the switches 12-20, sometimes 20 
referred to as routers, selectively direct frames over an 
optimized path 28-32, such as the path having the least 
traffic thereon, or the fastest communication link by various 
known techniques. While a switch fabric 10 is illustrated, the 
network 10 may comprise any point-to-point interconnec- 25 
tion network. 

Each of the nodes 22, 24, 26 includes a respective port 36, 
38, 40 (referred to sometimes as an N_Port) connected to a 
switch 12-20 of the fabric 10 for receiving frames from the 3Q 
respective switch and for transmitting frames to the respec- 
tive switch, as will be discussed. Note that where a node has 
only a single port associated therewith, as is the case for 
nodes 22, 24, 26 and respective ports 36, 38, 40, the terms 
''node** and "port" are used interchangeably. Various types of 35 
nodes may be connected to the fabric 10; such as, a data 
storage node 22, including a data storage device 44 in 
communication with port 36, a workstation node 24, includ- 
ing a host computer 46 in communication with port 38, and 
a network node 26 including a network interface 48 in ^ 
communication with port 40. Such a network interface 48 is 
further adapted for connection to a network (hot shown) 
having additional nodes connected thereto. It will be appre- 
ciated that other types of nodes may be connected to the 
fabric 10 and that additional nodes (not shown) may be 
connected to the fabric 10. 

The node ports 36-40 include apparatus for reordering 
frames of a packet received by the respective node in an 
order other than the order in which the frames are arranged 
in the packet as transmitted, as will be discussed. In one 50 
embodiment, the transmitted packets have a format defined 
by a Fibre Channel standard (in a specification entitled 
"FIBRE CHANNEL PHYSICAL AND SIGNALING 
INTERFACE STANDARD" (FC-PH) Rev. 4.3, X3, 
230-1994) and shown in FIGS. 2A and 2B for transmission 55 
over a Fibre Channel fabric. However, it will be appreciated 
that the invention may be used with various types of fabrics 
10 which permit frames of various formats to be received at 
a destination node in an order different than the order in 
which the frames were transmitted. 60 

Referring also to FIG. 2A, an illustrative Fibre Channel 
packet 34 is shown to include a plurality of frames SOa-n 
spaced by idle words. Considering the format of exemplary 
frame 50a, each frame includes a Start-of-Frame (SOF) field 
52a having a length of four bytes and indicating the class of 65 
service requested for the transmission and whether or not the 
frame 50a is the first or last in the packet 34 as transmitted. 
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More particularly, a Fibre Channel fabric supports three 
classes of packet transmission service. In one such class of 
service, a packet is transmitted over a single path 28-32, 
thereby precluding frames of the packet from arriving at a 
receiving node out of order. The remaining two classes of 
packet transmission service permit individual frames ' of a 
packet to be transmitted over different paths 28-32, and 
differ from one another in that, one such class of service 
requires that an acknowledgement, indicating that a frame 
was properly received, be sent by the receiving node to the 
transmitting node; whereas the other such class of service 
does not require an acknowledgement. Since frames of a 
packet can be transmitted over different paths 28-32 in the 
latter two classes of Fibre Channel service, such frames can 
arrive at the receiving node in an order different than the 
order in which the frames were transmitted. That is, while 
the transmitted packet includes a plurality of sequentially 
ordered frames (as specified by a sequence count contained 
within each frame), frames may be received at the receiving 
node out of this sequential order. 

A frame header 54a, twenty-four bytes in length, follows 
the SOF field 52a, and will be described further below in 
conjunction with FIG. 2B. A data field 56a having a length 
of between 0 and 21 12 bytes follows the frame header 54a, 
and, in rum, is followed by a four byte Cyclic Redundancy 
Check (CRC) field 58a which is used to verify the integrity 
of the frame 50a. A four byte End-of-Frame (EOF) field 60 
follows the CRC field 58a and indicates whether or not the 
frame 50a is valid or corrupted. 

Referring also to FIG. 2B, the header 54a of exemplary 
frame 50a is shown to include six words 62, 64, 66, 68, 70, 
and 72, each thirty-two bits long. The first byte of the first 
word 62 provides an R_CTL field 74 which defines the 
frame type as containing either a data field length of zero 
(i.e., a link control frame) or a data field length of between 
zero and 2112 bytes (i.e., a data frame). The remaining three 
bytes of the first word 62 provide a D_ID field 76, identi- 
fying the destination node and three bytes of the second 
word 64 provide an S_ID field 78, identifying the source 
node. The first byte of the third word 66 provides a TYPE 
field 80 which, in conjunction with the R_CTL field 74, 
specifies the protocol of the data associated with the frame. 
Trie remaining three bytes of the third word 66 provide an 
F_CTL field 82 which contains control information regard- 
ing the frame, including a one bit flag, at bit nineteen, 
indicating whether the frame 50a is the last frame of the ■ 
packet 34 according to the order in which the frames were 
transmitted. The first byte of the fourth word 68 provides a 
SEQ_ID field 84 which contains an identifier of the 
sequence, or packet 34 with which the frame 50a is asso- 
ciated and is followed by a DF_CTL field 86 which 
specifies the presence of optional header bits at the begin- 
ning of the data field 56a, A sixteen bit SEQ_CNT field 88 
is also provided in the fourth word 68 and contains a unique 
identifier of the frame 50a within the packet 34, referred to 
hereinafter as the sequence count Note that where the SOF 
field 52a of a received frame 50 indicates that the frame is 
the first of the associated packet based on the order in which 
the frames appear in the packet as transmitted, then the 
sequence count of the frame provides a lowest sequence 
count, for use in a manner described below. Similarly, where 
bit nineteen of the. F_CTL field 82 of a received frame 
indicates that the frame is the last in the respective packet as 
transmitted, then the sequence count of that frame provides 
a highest sequence count, for use in a manner described 
below. 

The fifth word 70 of the header 54 includes an OX_ID 
field 90 and an RX_ID field 92. The OX_JD and RX_ID 
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fields 90, 92 cany an exchange identifier provided by the 
source node and the destination node, respectively. The sixth 
word 72 of the frame header 54a contains a parameter field 
94, the content of which varies in accordance with whether 
the frame 50a is a link control frame or a data frame. 5 
Referring to FIG. 3, the ports 36, 38, 40 will be described * 
in conjunction with illustrative port 38 which, along with 
host computer 46, comprises workstation node 24 (FIG. 1). 
It will be appreciated however that the ports 36-40 associ- 
ated with each of the nodes 22-26 have like construction and 10 
are adapted for connection to a system, such as a host 
computer or data storage device, having a processor 156 and 
a system memory 158. 

Port 38 includes a Receive Frame Manager 100 which is 
responsive to frames 50o-n received by the port 38 for 15 
providing an entry in a memory 126 for each such frame 
50a-n received out of the sequential order in which the 
frame SOa-n appears in the transmitted packet 34, as will be 
described. A list of each such memory entry associated with 
a given packet 34 provides a reassembly table for use in 20 
reordering the frames SOa-n to reassemble the packet 34. 
More particularly, the system processor 156 accesses the 
reassembly table, processing the entries contained therein, to 
reorder the received frames 50o-/i. 

25 

The port 38 includes a parallel interface 104 connected to 
a serializer/deserializer (not shown) which is part of the 
node 24, positioned between the switch 18 and the port 38. 
The serializer/deserializer converts the serial Fibre Channel 
signals into digital signals for processing by the port 38. 3Q 
Thus, the parallel interface 104 receives parallel signals via 
a receipt signal line 106 and transmits parallel signals via a 
transmit signal line 108. The parallel interface 104 clocks 
incoming words of frames 50a~n from the receipt line 106 
into a Frame receiver 110. As a frame 50a-n (referred to 35 
hereinafter generally as frame 50, including an SOF field 52, 
a header 54, data 56, a CRC field 58 and an EOF field 60) 
is received, the Frame receiver 110 separates the frame 
header 54 from the data 56 for further processing. The frame 
data 56 is transferred to a Frame Data FIFO 116 and the 4Q 
remainder of the frame 50, including the frame header 54, is 
transferred to a Frame Header FIFO 114. The frame header 
54 is processed by a Frame preprocessor 120 connected to 
the Frame Header FIFO 114; whereas, the frame data 56 is 
transferred, via a Local Memory Manager 124 to local 45 
memory 126 for temporary storage. Note that while the local 
memory 126 is shown to be contained within the port 38, 
memory 126 may, alternatively, be located external to the 
port 38. 

The Frame preprocessor 120 checks the CRC field 58 of 50 
the received frame 50 to determine whether the frame has 
been accurately received In the event that the frame 50 has 
not been accurately received, the frame 50 is discarded. The 
Frame preprocessor 120 additionally determines whether the 
D_ ID field 76 of the frame header 54 corresponds to the 55 
node 24 associated with the receiving port 38. In the event 
that the frame destination node specified in header field 76 
does not match that of the receiving node 24, a reject frame 
is routed back to the fabric, for the first two classes of 
service, or discarded for the third class of service. After go 
processing the frame header 54, the Frame preprocessor 120 
transfers the frame header 54 to the Receive Frame Manager 
100. 

The Receive Frame Manager 100 controls the transfer of 
received frame data 56 from the local memory 126 to the 65 
system memory 158. More particularly, the Receive Frame 
Manager 100 programs a DMA controller 130 to move data 
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56 out of the local memory 126 and transfer such data to the 
system memory 158. The DMA controller 130 achieves this 
transfer of data 56 via a Write Data FIFO 132, a Read Data 
FIFO 142, the Local Memory Manager 124, and a System 
Interface 102. System Interface 102 permits communication 
between the host computer 46 and the port 38 via a system 
bus 112, by translating signals internal to the port 38 into 
signals compatible with the host computer 46. 

When the port 38 transmits a frame 50 to the respective 
switch 18 (FIG. 1), a Transmit Frame Manager 140 pro- 
grams the DMA controller 130 to read data 56 out of the 
system memory 158. The data 56 read by the DMA con- 
troller 130 is enqueued in a Frame Data FIFO 144 for 
transmission by a Frame transmitter 146. The Frame trans- 
mitter 146 transmits the header 54 followed by the frame 
data 56. The header 54 may be provided by the Transmit 
Frame Manager 140 or, alternatively, may be provided 
directly by the host computer 46. The Frame transmitter 146 
is additionally responsive to a Response FIFO 148 which 
contains entries corresponding to acknowledgements pro- 
vided by the Receive Frame Manager 100 that a frame was 
accurately received, as required by the first and second 
classes of a Fibre Channel service discussed above. 

A Receive cache 150 is provided in communication with 
the Receive Frame Manager 100 and the Local Memory 
Manager 124 via a local memory Write Data FIFO 152 and 
a local memory Read Data FIFO 154. The Receive cache 
150 stores a context associated with each packet processed 
by the port 38 for use by the Receive Frame Manager 100 
in reordering packet frames, as will be described. Similarly, 
a transmit cache 160 is provided in communication with the 
Transmit Frame Manager 140 and the Local Memory Man- 
ager 124 via a local memory Write Data FIFO 162 and a 
local memory Read Data FIFO 164, as shown. The transmit 
cache 160 functions in a manner similar to the receive cache 
operation described below, albeit in the transmission of 
frames as opposed to the receipt of frames. 

Referring also to FIG. 4, the Receive Frame Manager 100 
includes a Receive Sequence state machine 170 and a 
Control state machine 174, both of which are in communi- 
cation with the Frame preprocessor 120 (FIG. 3). The 
Receive Sequence state machine 170 is further in commu- 
nication with the System Interface 102, the Receive cache 
150 and the Local Memory Manager 124, as shown. The 
Control state machine 174 is connected to the DMA con- 
troller 130 and to the Response FIFO 148. 

The Receive Frame Manager 100 additionally includes a 
current context 178, the contents of which are particular to 
the packet 34 associated with a currently processed frame 
50. More particularly, each port 38 is capable of processing 
multiple packets 34 at any given time. When a frame 50 is 
received by the port 38, the packet 34 in which it resides is 
determined and the contents of the current context 178 are 
loaded with contents associated with that packet 34, as will 
be described. 

The current context 178 includes registers 118 for main- 
taining information about the respective packet 34. Specifi- 
cally, the context registers 118 include a Sequence Count 
register 122 which, in the illustrative embodiment, is sixteen 
bits long and stores a value equal to the sequence count of 
a next expected frame. To this end, when a frame 50 is 
received by the port 38, the Sequence Count register 122 is 
modified to contain the sequence count of the received frame 
50 plus one. A Data Length register 128 is also provided in 
the context 178 and contains a value corresponding to the 
length of data associated with a set of one or more prior 
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consecutively received frames. In the illustrative embodi- 
ment, the Data Length register 128 is thirty-two bits long. 
The context registers 118 further include a Frame counter 
134 for maintaining a sixteen bit count of the total number 
of frames SOa-n of a given packet 34 received by the port 
38. A forty-four bit Previous Data Pointer register 136 is 
provided for maintaining a pointer, referred to hereinafter as 
the PREVIOUS DATA pointer to a location in the system 
memory 158 beginning at which is stored. Also provided in 
the context 118 is a CURRENT DATA Pointer register 138 
which maintains a pointer, referred to hereinafter as the 
CURRENT DATA pointer, to a next available location in the 
system memory 158 for storing incoming frame data 56. 

Upon receipt of a frame 50, the Control state machine 174 
determines whether the type of service associated with a 15 
received frame 50 requires an acknowledgement to be sent 
to the source node indicating whether the frame was prop- 
erly received, as specified in the SOF field 52 of the frame 
50, If the class of transmission service requires an acknowl- 
edgement, the Control state machine 174 generates the 20 
acknowledgement and enques such acknowledgement in the 
Response FIFO 148. 

As noted above, the Receive Frame Manager 100 pro- 
grams the DMA controller 130 to read frame data 56 out of 
the local memory 126 and transfer such data to the system 
memory 158 via the system bus 112. Specifically, the 
Control state machine 174 programs the DMA controller 
130 to read the data 56 into locations of the system memory 
158 starting at the location pointed to by the CURRENT 
DATA pointer maintained in a CURRENT DATA Pointer 
register 138. 

Once a frame 50 is received and the header 54 transferred 
to the Receive Frame Manager 100, the Receive Sequence 
state machine 170 generates a tag associated with the 
received frame 50 for comparison to contexts stored in the 
Receive cache 50. More particularly, the tag includes the 
source identification from the S_ID field 78 of the frame 
header 54, the sequence identification from the SEQ_ID 
field 84 of the header 54, and the OX_ID field 90 from the 
header 54. If the generated tag matches a tag stored in the 
Receive cache 150, then the contents of the matching 
context maintained in the cache 150 are loaded into the 
current context 178 maintained in the Receive Frame Man- 
ager 100 and the packet 34 containing the received frame 50 
is referred to as a solicited transmission. Alternatively, if the 
generated tag does not match a context stored in the Receive 
cache 150, then the Receive Sequence state machine 170 
prompts the system processor 156 for initialized contents for 
the current context 178 and the packet 34 associated with the 
received frame 50 is referred to as an unsolicited transmis- 
sion. 

Referring to FIG. 5, an illustrative format of a reassembly 
table 180 maintained in the Local Memory 126 for a packet 
34 is shown. Recall that a reassembly table 180 is stored for 
each processed packet, such as packet 34. The table 180 
includes one entry 182a-182n-l for each frame of the packet 
34 received non-consecutively with respect to a previously 
received frame and a last entry 182n corresponding to the 
last frame of the packet to be received 

Each table entry 182a-n includes a respective sequence 
count field 184a-n which is sixteen bits long, a respective 
data pointer field 186a-n which is forty-four bits long, and 
a respective data length field 188a-n which is thirty-two bits 
long. The sequence count field 184a-n contains the 
sequence count of the last consecutively received frame and 
is provided by the Sequence Count register 122 of the 
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current context 178. The data pointer field 186a-ft contains 
a pointer to a location in the system memory 158 beginning 
at which sequential frame data is stored until a received 
discontinuity and is provided by the Previous Data Pointer 
register 136 of the current context 178. That is, the DATA 
POINTER points to the first location at which a set of one 
or more consecutive frames, received prior to the process, 
non-consecutively received frame, is stored. The data length 
field l8Sa-n contains a value indicating a length of data 
received by the port 38 since receipt of a last non-consecu- 
tively received frame (i.e., the length of data associated with 
the set of prior, consecutively received frames) and is 
provided by the Data Length register 128 of the current 
context 178. 

Referring to FIGS. 6A and 6B, flow diagrams show an 
illustrative process by which frames 50a~n received out of 
sequential order by the port 38 are reordered. In step 200, the 
port 38 is powered up or connected to the fabric 10. The port 
38 is initialized in steps 202-208 by initializing the contents 
of the current context registers 118 maintained in the 
Receive Frame Manager 100. Specifically, the Data Length 
register 128 is set to zero in step 202, the Sequence Count 
register 122 is set to the expected first sequence count in step 
204, the PREVIOUS DATA pointer in the Data Pointer 
register 136 is set to the value of the CURRENT DATA 
pointer in the CURRENT DATA Pointer register 138 in step 
206 and the Frame counter 134 is set to zero in step 208. 
Note that where a particular transmission includes a single 
packet, the Sequence Count register 122 is initialized to a 
value of zero. However, where a streamed sequence, includ- 
ing more than one packet is transmitted, the Sequence Count 
register 122 will be initialized to a value indicating the next 
sequential sequence count after the highest sequence count 
of a previously received packet of the streamed sequence. 

Having initialized the current context 178, it is deter- 
mined, in step 210, whether a frame SQa~n has been received 
by the port 38. Step 210 is repeated until a frame 50a-n is 
received. When a frame 5da-n, such as illustrative frame 
50a, is received, the context 178 of the Receive Frame 
Manager 100 is loaded (unless the received frame 50a is the 
first frame of a packet in which case the registers remain in 
their initialized states provided in steps 202-208). More 
particularly, in step 212, the frame tag described above is 
generated by the Receive Sequence state machine 170 and is 
compared to tags stored in the Receive cache 150. If the 
generated tag is found to match a stored tag, then the 
contents of the current context registers 118 are loaded from 
the Receive cache 150 in accordance with registers associ- 
ated with the matching tag. Alternatively, if the generated tag 
does not match a tag stored in the Receive cache 150 (i.e., 
if the received frame 50a is the first frame associated with 
a packet to be received), then the system processor 156 
initializes the current context registers 118, in the same 
manner as the context 178 is initialized after system power 
up in steps 202-208. 

Thereafter, in step 214, the frame data such as data 56a of 
received frame 50a, is stored in the system memory 158 at 
the location pointed to by the CURRENT DATA pointer 
(i.e., after having been temporarily stored in local memory 
126). In step 216, the Frame counter 134 is incremented by 
one. In step 218, it is determined whether the sequence count 
of the received frame 50a is equal to the sequence count 
stored in the Sequence Count register 122. If the two 
sequence counts are equal, then the received frame 50a is 
consecutive with respect to the previously received frame 
(or, is the first frame of a packet to be received and is also 
the first sequential frame of the packet as transmitted) and no 
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entry is made in the reassembly table 180. Alternatively, if 
it is deterrriined in step 218 that the sequence count of the 
received frame 50a is not equal to the sequence count stored 
in the Sequence Count register 122, then the received frame 
50a is non-consecutive with respect to a previously received 
frame (or is the first frame of a packet to be received but is 
not the first sequential frame of the packet as transmitted) 
and an entry is made in the reassembly table 180. 

Consider first the case where the sequence count of the 
received frame 50a is equal to the value in the Sequence 
Count register 122. In this case, no entry is made into 
memory and the current context registers 118 are reset in 
preparation for receipt of a subsequent frame in steps 220, 
222, and 224. Specifically, the value in the Sequence Count 
register 122 is incremented by one in step 220, in prepara- 
tion for comparison to the sequence count of a subsequently 
received frame. The value in the Data Length register 128 is 
incremented by the length of the received frame data 56a in 
step 222. In step 224, the CURRENT DATA pointer in 
register 138 is incremented by the length of the received 
frame data 56a, to indicate that the next available memory 
location is after the stored data 56a. 

In the case where the sequence count of the received 
frame 50a is not equal to the value in the Sequence Count 
register 122, then step 226 is performed (FIG. 6B) after step 
218, in which it is determined whether the Frame counter 
134 is at a value of one. If it is determined that the Frame 
counter 134 is at one, thereby indicating that the received 
frame 50a is the first frame of the packet 34 received, then 
step 234 is next, performed and no entry is made into the 
reassembly table 180. If, on the other hand, it is determined 
in step 226 that the value of the Frame counter 134 is not 
equal to one, then the non-consecutively received frame is 
not the first frame received and steps 228, 230 and 232 are 
performed in which an entry is made in the reassembly table 
180. Specifically, in step 228, the Sequence Count register 
value is decremented by one and the decremented value is 
inserted into the sequence count field 184a of the first entry 
182a in the reassembly table 180. In step 230, the PREVI- 
OUS DATA pointer from the Previous Data Pointer register 
136 is inserted into the data pointer field 186a of the memory 
entry 182a and in step 232, the value stored in the Data 
Length register 128 is inserted into the data length field 188a 
of the memory entry 182a. 

Thereafter, the current context registers 118 are reset in 
preparation for the next received frame 50a-*» in steps 234, 
236, 238, and 240. Note that where the Frame counter 134 
is determined to be equal to one in step 226, step 234 is 
performed directly after step 226, In step 234, the Sequence 
Count register 122 is set to a value of one plus the sequence 
count of the received frame, for comparison to the sequence 
count of a subsequently received frame 50a-n. In step 236, 
the PREVIOUS DATA pointer is made to point to the same 
location as the CURRENT DATA pointer. In step 238, the 
Data Length register 128 is set to by the length of data 56a 
associated with the received frame 50a. And, in step 240, the 
CURRENT DATA pointer is incremented by the length of 
the received frame data 56a, to point to the next available 
memory location for storing incoming frame data. 

In step 242, it is determined whether all of the frames 
50a-n of the packet 34 have been received. Specifically, the 
value in the Frame counter 134 is compared to one more 
than the difference between the highest sequence count and 
the lowest sequence count, as determined from bit nineteen 
of the F_CTL field 82 of the header of the received frame 
and the SOF field 52 of the received frame, respectively. A 
Frame counter value equal to one more than the highest 
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sequence count minus the lowest sequence count indicates 
that all of the frames 5Qa-n of the packet 34 have been 
received. The above-described process is repeated, starting 
at step 210, until the last frame associated with the packet 34 
is received. 

Once the Frame counter 134 indicates that all of the 
frames 50a-n for a particular packet 34 have been received, 
the last entry 182/i is made in the reassembly table 180 in 
steps 244, 246, and 248. Specifically, in step 244, the 
Sequence Count register 122 is decremented by one and the 
decremented value is inserted into the sequence count field 
184n of the last entry lS2n. In step 246, the PREVIOUS 
DATA pointer from the Data Pointer register 136 is inserted 
into the data pointer field 186n of the last memory entry 
182n and, in step 248, the value stored in the Data Length 
register 128 is inserted into the data length field 188n of the 
last memory entry 182n. 

In order to illustrate the operation of the port 38 in 
reordering non-consecutive frames, consider two cases 
where a packet 34', including six frames 50a-50/ having 
respective sequence counts of 0-5, consecutively, and trans- 
mitted in the order shown in FIG. 7A, is received by the port 
38. Specifically, consider first the case where the frames 
50a-50/ are received by the port 38 in the following order: 
frame 50a, frame 50a, frame 50/, frame 50c, frame 50** and 
frame 50e, as shown in FIG. 7B. The frames 50a-50/have 
respective data fields 56a~56f with lengths as indicated in 
the data fields 56a-56/ in FIGS. 7A-C. FIG, 8 shows a 
portion of the system memory 158 at which the data 
56a-56/, associated with the frames 50a-50/, respectively, 
of FIG. 7B are stored. FIG. 9 shows the reassembly table 
180' generated by the Receive Frame Manager 100 and 
stored in local memory 126 in response to receipt of frames 
50a-50/in the order illustrated in FIG. 7B, 

When the first frame 50a is received, the registers 118 of 
the current context 178 are in their initialized states (i.e., 
because the tag generated in response to receipt of frame 50a 
was found not to match a tag in the Receive cache ISO so the 
system processor 156 initialized the current context 178 in 
step 212). Thus, the Sequence Count register 122 is at a 
value of zero, the Data Length register 128 is at a value of 
zero and the Frame counter 134 is at a value of zero. Also, 
the PREVIOUS DATA pointer points to the location 250 
(FIG. 8) to which the CURRENT DATA pointer is initialized 
by the system processor 156. 

The data 56a associated with the received frame 50a is 
stored in system memory 158, starting at the location 250 
pointed to by the CURRENT DATA pointer in step 214. In 
step 216, the Frame counter 134 is incremented by one, to 
a value of one. When the sequence count of the received 
frame 50a (i.e., zero) is compared to the sequence count of 
zero contained in the register 122 in step 218, it is deter- 
mined that the two sequence counts are equal, thereby 
indicating that the frame 50a has been received in the same 
order in which it was transmitted. 

In accordance with the process discussed above, there will 
not be an entry made in the reassembly table 180' in response 
to receipt of frame 50a since the frame 50a is received in the 
same order in which it appears in the transmitted frame 34, 
namely first Stated differently, frame 50a is the first 
expected frame. The registers 118 of the context 178 are 
incremented in steps 220-224. Specifically, in step 220, the 
Sequence Count register 122 is incremented by one, to a 
value of one. In step 222, the Data Length register 128 is 
incremented by the length of the data 56a associated with the 
received frame 50a, to a value of 5 12 bytes. And, in step 224, 



03/24/2004, EAST Version: 1.4.1 



5,619,497 



13 



14 



the CURRENT DATA pointer is incremented by the length 
of the data 56a associated with the received frame 50a (i.e., 
in the illustrative example, by 512 bytes, to memory location 
252). 

Thereafter, in step 242 (FIG. 6B), it is determined that the 
Frame counter 134, now at a value of one, is not equal to one 
more than the difference between the highest sequence count 
of five and the lowest sequence count of zero. Thus, since the 
received frame 50a is not the last frame of the packet 34', the 
process is repeated, starting at step 210. 

When the second frame 50b associated with the packet 34' 
is received, generation of the tag associated with the incom- 
ing frame 50b and comparison of the generated tag to the 
current context 178 in the Receive Frame Manager 100 in 
step 212 reveals that the subsequently received frame 50b is 
associated with the same packet 34' as the previously 
received frame 50a. Thus, the contents of the context 178 are 
maintained for further processing in conjunction with frame 
5%. The data 56b associated with the frame 50b is stored in 
the system memory 158 starting at the memory location 252 
pointed to by the CURRENT DATA pointer in register 138 
in step 214. In step 216, the Frame counter 134 is incre- 
mented by one, to indicate that two frames 50a and 50b of 
the packet 34' have been received. 

The determination of process step 218 reveals that the 
sequence count of one, of the received frame 50b equals the 
current value of one in the Sequence Count register 122. 
Thus, no entry is made in the reassembly table 180' in 
response to receipt of the frame 50b since frame 50b is 
consecutive with respect to the previously received frame 
50a. Thereafter, the registers 118 are incremented in steps 
220-224. Specifically, in step 220, the Sequence Count 
register 122 is incremented by one to a value of two. In step 
222, the Data Length register 128 is incremented by the 
length of the received frame data 56b, In the illustrative case, 
the Data Length register 128 is incremented by 256 bytes, to 
768 bytes. In step 224, the CURRENT DATA pointer is also 
incremented by the length of the received frame data 56fe to 
point to memory location 254 in FIG. 8. 

In step 242, it is determined that the received frame 50b 
is not the last frame of the packet 34* to be received, thereby 
causing the process to be repeated a third time, starting at 
step 210. Since the next frame received 50/ is non-consecu- 
tive with respect to the previously received frame 50b, it is 
determined in step 218 that the sequence count of five, 
associated with the received frame 50/ is not equal to the 
sequence count value of two currently stored in the register 
122. Thus, a first entry 182a' will be provided in the 
reassembly table 180' in response to non-consecutive frame 
50/ as follows. 

Since the value in the Frame counter 134 is not equal to 
one (as determined in step 226), the Sequence Count register 
122 is decremented by one, to a value of one and this 
decremented value of one is inserted into the sequence count 
field 184a' of the first entry 182a' of the table 180' in step 
228, as shown in FIG. 9. The data pointer field 186a' of the 
entry 182a' contains the PREVIOUS DATA pointer from 
register 136 which still points to location 250 and the data 
length field 188a' of the entry 182a' contains the value from 
the Data Length register 128, of 768 bytes. 

Once the first memory entry 182a' is completed, the 
registers 118 are readied for receipt of a subsequent frame, 
in steps 234-240, by setting the Sequence Count register 122 
to one plus the sequence count of the received frame (i.e., to 
a value of six), by moving the CURRENT DATA pointer to 
the PREVIOUS DATA pointer location 254, by setting the 
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Data Length register 128 to the length of data 56/ of 
associated with the third received frame 50/ of 1024 bytes, 
and by incrementing the CURRENT DATA pointer main- 
tained in register 138 by 1024 bytes (Le., the length of the 
data 56/ associated withthe frame 50/) to point to location 
256 at byte 1792. 

Frame 50c is the fourth frame to be received. Since the 
Sequence Count register 122 is now at a value of six, it is 
determined that the sequence count of two of the received 
frame 50c is not equal to the value in the Sequence Count 
register 122. Thus, in response to receipt of frame 50c, there 
will be a second entry 182fc' provided in the reassembly table 
180'. In step 226, it is determined that the Frame counter 
134, now at a value of four, is not equal to one, Thus, the 
Sequence Count register 122 is decremented by one, to a 
value of five, and this value of five is inserted into the 
sequence count field 184fc' of the second entry 182fc'in the 
reassembly table 180Mn step 230, the PREVIOUS DATA 
pointer, pointing to location 254, is inserted into the data 
pointer field \%6b ' of the second entry 182&' in the reassem- 
bly table 180'. The second table entry 182&' is completed in 
step 232 by the insertion of the value in the Data Length 
register 128, in this case, a value of 1024 bytes, as shown in 
FIG. 9. 

Steps 234-240 are next performed in which the registers 
118 are again reset in preparation for receipt of a subsequent 
frame. Specifically, the Sequence Count register 122 is set to 
a value of one more than the sequence count of the received 
frame, or in this case a value of three. In step 236, the 
PREVIOUS DATA pointer is modified to point to memory 
location 256 to which the CURRENT DATA pointer cur- 
rently points. In step 238, the Data Length register 128 is set 
to the length of the data 56c associated with the received 
frame 50c. And, in step 240, the CURRENT DATA pointer 
is incremented by the length of the received data 50c, here 
512 bytes, to point to memory location 258. Thereafter, in 
step 242, it is determined that the received frame 50c is not 
the last frame associated with the packet 34', causing the 
process to be repeated again, starting at step 210. 

When the fifth frame SOd is received, the Frame counter 
134 is incremented by one, to a value of five. It is deter- 
mined, in step 218 that frame 50a* is consecutive with respect 
to previously received frame 50c. Thus, no entry is made in 
table 180* in response to frame 50c and the registers 118 are 
reset in steps 220-224. Specifically, the Sequence Count 
register 122 is incremented by one in step 220 to a value of 
four and the Data Length register 128 is incremented by 
length of data 56a* associated with the received frame SOd 
(i.e., by 2048 bytes) to a value of 2560 bytes in step 222. 
Also, the CURRENT DATA pointer is incremented by the 
length of the data 56d to a point to memory location 260 in 
step 224. 

Finally, frame 50e is received and processed in the same 
manner as the preceding frame 50a*, since frame 50e is 
consecutive with respect to the previously received frame 
SOd. Thus, since the sequence count of four of the received 
frame 50* is equal to the current value of four in the 
Sequence Count register 122, no entry is made in the 
reassembly table 180* in response to frame 50J. The 
Sequence Count register 122 is incremented by one, to a 
value of five, in step 220 and the Data Length register 128 
is incremented by the length of data 56<r associated with the 
received frame 50e in step 222, to a value of 2688 bytes. 
Also, in step 224, the CURRENT DATA pointer is incre- 
mented by 128 bytes to point to memory location 262.* 

Thereafter, in step 242, it is determined that the Frame 
counter 134 is at a value equal to one more than the highest 



03/24/2004, EAST Version: 1.4.1 



5,619, 

15 

sequence count minus the lowest sequence count, or six, the 
total number of frames in the illustrative packet 34*. In 
response to this determination, Sequence Count register 122 
is decremented by one, to a value of five, and this value is 
inserted into the sequence count field 184c' of the last 5 
memory entry 182c' in step 244. Additionally, the PREVI- 
OUS DATA pointer location 256 is inserted into the last 
memory entry 182c' in step 246 and the Data Length register 
value of 2688 is inserted into memory entry 182c' in step 

With this arrangement, a reassembly table 180' has been 
generated including an entry for each non-consecutively 
received frame 50/ and 50c, and for the last frame 50e of the 
packet 34' to be received. The table 180' is now ready for 
processing by the system processor 156 to reorder the 
frames SQa-SQf so as to reassemble the packet 34'. Specifi- 
cally, the system processor 156 processes each of the entries 
182a -182c' in ascending order of sequence count. Thus, 
entry 182a' is processed first, followed by entry 182c' and 
finally by entry 182*'. 

Processing of an entry is achieved by accessing memory 20 
locations starting at the pointer contained in the pointer field 
for the entry and specifically, accessing a number of memory 
locations specified by the data length field of the entry. Thus, 
the packet 34' is reassembled by processing entry 182a' by 
reading 768 bytes of memory starting at location 250, W 
followed by reading 2688 bytes of memory starting at 
location 256 and finally, by reading 1024 bytes of memory 
starting at location 254. In this way, the reassembled packet 
34' is provided. 

Referring to FIG. 7C, consider the case where the frames 30 
50a-50/of the transmitted packet 34' (FIG. 7A) are received 
by the port 38 in the following order frame 506, frame 50a, 
frame 50/, frame 50c, frame 50d and frame 50*, as shown in 
FIG. 7C. This example illustrates the case where the first 
frame of a packet to be received is not the first frame of the 35 
packet as transmitted (i.e., where the received frame is not 
the expected first frame). FIG. 10 shows a portion of the 
system memory 158 at which the data 56a-56/, associated 
with frames 50a-50/, respectively, are stored and FIG. 11 
shows the reassembly table 180" generated by the Receive 40 
Frame Manager 100 and stored in local memory 126 in 
response to receipt of frames SOa-SOfin the order illustrated 
in FIG. 7C 

Prior to receipt of frame 50b, the registers 118 of the 
context 178 are initialized in steps 202-208, as described 45 
above. Thus, the Sequence Count register 122 is at a value 
of zero (assuming that the frame having a sequence count of 
zero is the first expected frame), the Data Length register 
128 is at a value of zero, the PREVIOUS DATA pointer 
register 136 points to the same memory location to which the 50 
CURRENT DATA pointer is initialized. When frame 50b is 
received, the frame data 56b is stored at the initialized 
memory location 270 pointed to by the CURRENT DATA 
pointer and the Frame counter 134 is incremented by one, to 
a value of one. In step 218, it is determined that the sequence 55 
count of the received frame 50b (i.e., a sequence count of 
one) is not equal to the value of zero stored in the Sequence 
Count register 122. Thus, process step 226 is next performed 
in which it is determined that the Frame counter 134 is at a 
value of one. This determination corresponds to the special 60 
case where the first frame to be received is not the expected 
first frame (i.e., is not the first frame of the packet 34' as 
transmitted). In this case, no entry is made in the memory 
table 180" for this first, non-consecutively received frame 
SOB. Rather, after step 226, steps 243-240 are performed, in 65 
which the registers 118 are reset in preparation for receipt of 
a subsequent frame. 
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Specifically, in step 234, the Sequence Count register 122 
is set to a value of one greater than the sequence count of the 
received frame, or in this case to a value of two. In step 236, 
the CURRENT DATA pointer is moved to the PREVIOUS 
DATA pointer location 270 and in step 238, the Data Length 
register 128 is set to the length of the received frame data 
56b (i.e., to 256 bytes). In step 240, the CURRENT DATA 
pointer is incremented by the length of the received frame 
data 56c, to memory location 272. Thereafter, in step 242, it 
is determined that the Frame counter value of one is not 
equal to one more than the difference between the highest 
sequence count and the lowest sequence count, thereby 
indicating that the last frame of the packet has not been 
received. Thus, the process is repeated, starting at step 210. 

Once the next frame 50a is received, it is determined that 
the tag associated with the received frame 50a matches the 
tag associated with previously processed frame 50b. Thus, in 
step 212, the contents of the current context 178 are main- 
tained for processing frame 50a. In step 214, the data 56a, 
associated with frame 50a, is stored starting at the memory 
location 272 pointed to by the CURRENT DATA pointer. In 
step 216, the Frame counter 134 is incremented to a value of 
two. Thereafter, in step 218, it is determined that the 
sequence count of zero of the received frame 50a is not 
equal to the sequence count value of two stored in the 
Sequence Count register 122. Thus, an entry 182a" will be 
made in the memory table 180" in response to receipt of 
frame 50a. 

In step 226, it is determined that the Frame counter 134 
is not equal to one, causing steps 228-232 to be performed, 
in which the first entry 182a * is made in the memory table 
180". Specifically, in step 228, the Sequence Count register 
122 is decremented by one, to a value of one, and that value 
is inserted into the first entry 182a" in table 180". In step 
230, the PREVIOUS DATA pointer pointing to memory 
location 270 is inserted into the entry 182a" and in step 232, 
the value of 256 bytes stored in the Data Length register 128 
is inserted into the entry 182a". 

In steps 234-240, again, the registers 118 are reset for 
receipt of the next frame. Step 234 causes the Sequence 
Count register 122 to be set to a value of one greater than the 
sequence count of the received frame, or to a value of one. 
The PREVIOUS DATA pointer is made to point to memory 
location 272 in step 236 and the Data Length register 128 is 
set to 512 bytes, the length of the data 56a associated with 
frame 50a. In step 240, the CURRENT DATA pointer is 
incremented by 512 bytes, to point to memory location 274. 
Since received frame 50a is not the sixth, and last frame of 
the packet to be received, the process is repeated. 

Thereafter, frame 50/ is received and the data 56/ asso- 
ciated with the received frame is stored in memory starting 
at location 274, to which the CURRENT DATA pointer 
currently points. The Frame counter 134 is incremented to a 
value of three in step 216 and, in step 218, it is determined 
that the sequence count of five of the received frame 50/ is 
not equal to the sequence count of one in the register 122. 
Thus, since frame 50/ is received non-consecutively with 
respect to the previously received frame 50a, a second entry 
1826" is made in the table 180" in accordance with steps 
228-234. 

In step 228, the Sequence Count register 122 is decre- 
mented by one, to a value of zero and this decremented value 
is inserted into the second entry 1826" as shown in FIG. U. 
Also, the PREVIOUS DATA pointer location 272 is inserted 
into the second entry lS2b " in step 230 and the value of 5 1 2 
bytes in the Data Length register 128 is inserted into the 
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second entry 182&" in step 232. Since the subsequently physical connection between the respective channel 302 r 

received frames 50c, S0d t and 50e are received in the same 302* and the node 300. Thus, each port 304 r 304„ is 

order as described above in conjunction with the example of associated with a respective channel 302 r 302^. Further, 

FIGS. 7B, 8, and 9, the process by which entries 182c" and each port m r 3M N has a respective node client system 306, 

1824" are made into table 180 M is identical to the process 5 308 and 310 associated therewith and connected to the 

discussed above in which entries 182*' and 182c' are made sh ared node 300 via a system bus 316. Node clients 306, 

into the table 180'. 308, 310 may be of various types, such as the illustrated host 

The reassembly table 180" shown in FIG. 11 is processed computer 306, data storage device 308, or network interface 

in the same manner as table 180' discussed above. Specifi- 310. Preferably, the shared node 300 is integrated onto an 

cally, the system processor 156 processes entries 10 ASIC using 0.35 micron technology. 

ma"-m<T starting with the entry having the lowest Referring also to FIG. 13, the shared node 300 includes a 

sequence count. Thus, entry 182*" is processed first fol- portion 314 r 314„ dedicated to each port 304 r 304„ and a 

lowed by entry 182a", entry 182J" and finally 182c". The common portion shared by each of the ports 304 r 304„. The 

packet 34\of FIG. 7A is reassembled by reading 5 1 2 bytes common portion of the node 300 includes a frame handler 

from memory starting at location 272, followed by 256 bytes 15 320, a frame prioritization circuit 330 and a frame routing 

starting at memory location 270, 2688 bytes starting at c±*cuit 340. The shared node 300 is adapted for dynamically 

memory location 276 and finally, 1024 bytes starting a receiving frames of a packet from one or more source nodes 

memory location 274. over one or more res pective channels 302 r 302^ and for 

It will be appreciated that, in the case where a packet 34 transmitting frames of a packet to one or more destination 

is received in the same order as it is transmitted, the 2 ° nodes over one or more channels 302 1 -302 Ar . The shared 

reassembly table 180 for that packet 34 will contain only a node 300 operates dynamically, in the sense that frames can 

single entry, corresponding to the last frame of the packet 34 . be received by one or more ports simultaneously with 

to be received Such an entry includes the sequence count of respect to one another, while another frame is being pro- 

the last received frame, a pointer to the location in memory cessed by the frame handler 320. Thus, when the frame 

158 beginning at which the first frame of the packet 34 is 25 handler 320 processes a frame received at a particular port, 

stored, and a data length value indicating the cumulative the other ports are not rendered "busy" but rather, are 

length of data of each of the frames SOa-n of the packet 34. capable of receiving frames. 

It will be appreciated that various options exist for imple- The portion of node 300 dedicated to each port 304^304^ 

menting the port 38, such as by integrating the port com- includes a receiver and transmitter circuit 314,-314^ asso- 

ponents on an ASIC. It will also be appreciated that the order 30 ciated with a respective port 304J-304/V of the node 300. 

of the process steps of FIGS. 6 A and 6B may be varied Each of the receiver and transmitter circuits 314 1 -314 /v 

somewhat without departing from the spirit of the invention, includes circuitry for receiving frames at the respective port 

It will also be appreciated that, although the reassembly 304 r 304 Ar and for transmitting frames to the respective port 

tables are described hereinabove as being stored in local 35 304 1 -304 w > as will be discussed further in conjunction with 

memory 126 various memory configurations can be used FIGS. 14 and 14A. 

without departing from the spirit of the invention. For The frame handler 320 processes frames received by each 

example, the reassembly tables may be stored in the system of the ports 304 r 304^ More particularly, the frame handler 

memory 158. Furthermore, the entries in a reassembly table 320 performs various types of frame control and processing 

need not be stored in a contiguous block of memory loca- ^ functions, such as reordering frames of a packet received 

tions. out-of-order, in the manner described above. The frame 

Referring to FIG. 12, an alternate node embodiment 300 handler 320 includes a memory manager and memory 324 

is connected to the switch fabric 10. Recall from FIG. 1 that and a system interface 328. Hie memory manager and 

the switch fabric 10 includes a plurality of switches 12-20 memory 324 provide control and temporary storage - of 

interconnecting a plurality of nodes. In the network of FIG. 45 incoming frame data and the system interface 328 permits 

12, fabric 10 interconnects nodes 22 and 300. Node 22 communication between the node 300 and the node clients 

includes a port 36 of the type discussed above in conjunction 306, 308, 310 via bus 316. 

with FIG. 3. Since node 22 is associated with a single switch The receiver portion of each receiver and transmitter 

fabric channel 301, port 36 is used interchangeably with circuit 314 r 314^ separates the header 54a-n (FIG. 2) of 

node 22. Node 300 on the other hand is referred to as a 50 received frames 50a-w from the frame data S6a-n and 

shared node 300 and includes multiple ports 304 1 -304^ temporarily stores the headers 54a-n and data 56o-n thus 

adapted for connection to multiple respective channels 302 r separated. The headers 54a-n of the received frames are 

302^ of the switch fabric 10, as shown. The number of selectively forwarded by the frame prioritization circuit 330 

channels 302 r 302^ serviced by the node 300 and thus, the to the frame handler 320 via signal lines 332 r 332 w and 333 

number of ports 304 r 304^ of the node, may be readily 55 and the data 56a-n of the received frames are transferred to 

varied and is selected generally, in accordance with factors the memory manager and memory 324 via signal lines 

such as the node memory capacity, available circuit board 334^334^ 

area for the node, and the available pin count where the node The frame prioritization circuit 330 selects a frame header 

300 is incorporated onto an integrated circuit, such as an temporarily stored in one of the receiver and transmitter 

ASIC, as will become apparent. Preferably, the number of & circuits 314,414* in accordance with one of a plurality of 

channels 302 r 302„ serviced by the shared node 300 and port prioritization schemes and may alternatively be referred 

thus, the number of ports 304 r 304 M is a binary multiple to as a multiplexer 320. In one embodiment, each of the 

(i.e., 2, 4, 8, 16, ... )• ports 304,-304^5 assigned a priority at system initialization 

While the ports 36, 38, 40 of FIG. 1 are described as based on a predetermined criteria. For example, the prede- 

including the circuitry of FIG. 3, in the shared node 300, the 65 termined criteria may be based on the type of node client 

term "node" refers to the entire switch fabric interconnection associated with the respective port and/or the anticipated 

circuit and the ports 304 j -3 04^ refer to the terminal, or frame traffic on the respective port. In operation, the frame 
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prioritization circuit 330 initially forwards one or more 341 ,-341*. the circuitry contained in the Frame receiver 110 
headers from the receiver and transmitter circuit 314,-314* of FIG. 3; namely, a decoder 360,-360*. a PSR circuit 
associated with the port 304,-304* assigned the highest 362,-362*, a Frame Receive circuit 364,-364*. a Frame 
priority. Thereafter, the selection of subsequent frame head- Data FIFO 350,-350* and a Frame Header FIFO 352,-352*, 
ers for forwarding to the frame handler 320 is based on a 5 Considering illustrative circuit 314, , the decoder 360! pro- 
descending order of port priority. v ides the necessary 8B/10B decoder functions by which 

In accordance with another prioritization scheme, received transmission characters (i.e., each character being 

received frame headers 54a-n are selected for forwarding to . ten bits) are decoded into eight-bit codes. The PSR circuit 

the frame handler 320 in accordance with a predetermined 352, decodes primitive sequences, which are three consecu- 

order of ports, such as in a "round robin" fashion, in which 10 ti V e ordered Fibre Channel sets of the same type. An ordered 

the ports 304,-304* are polled in a consecutive repetition, se t i s a four character combination of data and special 

from port 304, to port 304*. Alternatively, the ports 304,- transmission characters. Illustrative types of ordered sets 

304* may be polled on a first frame received, first frame include frame delimiters which immediately precede or 

forwarded basis. follow the contents of a frame and primitive signals which 

A further, adaptive prioritization scheme is based on 15 are ordered sets designated to have special meaning, such as 

which port 304,-304* has received the most frames, the an idle. 

headers of which are temporarily stored by the respective a Fibre Channel Arbitrated Loop specification (FC-AL) 

receiver and transmitter circuit 314,-314*. More particu- r cv . 4,34 X3T11 Project 960D dated Sep. 18, 1994, which 

laxly, the frame prioritization circuit 330 accesses the i s incorporated herein by reference, describes both switch 

receiver and transmitter circuit 314,-314* with the most 20 f a bri c and arbitrated loop configurations. In an arbitrated 

stored frame headers for forwarding one or more such frame i 00 p configuration, nodes are daisy-chain connected to form 

headers to the frame handler 320. Subsequent receiver and a loop, with the transmitter circuitry of one node connected 

transmitter circuits 314,-314* are then accessed in a to the receiver circuitry of another. Nodes connected in an 

descending order of the most temporarily stored frame arbitrated loop configuration arbitrate for access to the loop 

headers. 25 Dv passing arbitration primitives around loop. Once a node 

Once a frame header 54a-n is forwarded to the frame obtains access to the loop, thereby becoming a source node, 

handler 320, the respective frame 50o-n is processed by the a destination node is "opened" and the transmission between 

frame handler 320. In response to a request by a node client the source node and destination node becomes a point to 

to transmit a frame, the frame is processed by the frame point transmission, with intermediate nodes positioned 

handler 320 and the processed frame is routed to the frame 30 between the source and destination nodes on the loop 

routing circuit 340 which receives the processed frame via passing data through to the next port on the loop, 

signal line 338, determines the destination node identified by The arbitrated loop circuit 344 r 344* associated with 

the frame and forwards the frame a port 304,-304* associ- eacn port 304,-304* is operable to pass frames through the 

ated with the destination node. The frame routing circuit 340 respective port 304,-304* when an arbitrated loop topology 

may alternatively be referred to as a demultiplexer and will 35 - s ulilized the reS pective port 304,-304* is an interme- 

be described further in conjunction with FIG. 16. diate port on the loop. For example, when port 304, is an 

Referring also to FIGS. 14 and 14 A, the receiver and intermediate port in an arbitrated loop configuration, the 

transmitter circuit 314,-314* associated with each port arbitrated loop circuit 344, passes received frames through, 

304,-304* includes a deserializer 341,-341*, a serializer for transmission to the next port on the loop. 

342,-342*, a decoder 360,-360*, an encoder 370,-370*, a 40 The Frame Receive circuit 364, encapsulates the neces- 

PSR (Primitive Sequence Recognition) circuit 362,-362*. a sary i og i c t0 properly receive the Fibre Channel frames, 

PSG (Primitive Sequence Generation) circuit 372,-372*, an verifies the transmitted CRC, and routes the frame data to a 

arbitrated loop (AL) circuit 344,-344*, a Frame Receive L^cal Memory Manager 382 of me frame handler 320. More 

circuit 364,-364*, a Frame Transmit circuit 376,-376*, a particularly, the Frame Receive circuit 364, separates the 

Frame Data buffer, or FIFO 350,-350*. a Frame Header 45 frame header 54 from the data 56 (FIG. 2) for further 

buffer, or FIFO 352,-352*. and a Frame Transmit buffer, or processing. The frame data 56 is transferred to the Frame 

FIFO 354,-354*. as shown. Since each receiver and trans- Data FIFO 350, for further transfer to a local memory 380 

mitter circuit 314,-314* is identical, illustrative circuit 314, via the Local Memory Manager 382. More particularly, the 

associated with port 304, will be described in greater detail. 5o Frame Receive circuit 364, passes controVdeliraiter data to 

Each channel 302,-302* (FIG. 12) has a pair of serial the Local Memory Manager 382, which in turn transfers the 

signal lines associated therewith, a first one of which carries frame data from Frame Data FIFO 350, to local memory 

frames serially to the respective port 304,-304* from the 380. The frame header 54 is transferred to the Frame Header 

switch fabric and a second one of which carries frames FIFO 352, for temporary storage, 

serially from theport 304,-304* to the switch fabric 10. The 55 The Frame Header FIFOs 352,-352* are connected to the 

deserializer 341, converts serial frame data received at port frame prioritization circuit 330 via signal lines 332,-332* 

304, into parallel frame data. Similarly, the serializer 342, ^ 356,-356*, as shown. Frame headers are forwarded to 

converts the parallel frame data into a single serial signal. the frame prioritization circuit 330 via signal lines 332,- 

Although preferably, the deserializer 341, and serializer 332* and control signals described below are transferred via 

342, are incorporated onto the shared node ASIC 300, the signal lines 356,-356*, The frame prioritization circuit 330 

deserializer and serializer may alternatively be external to forwards selected received frame headers to the frame 

the node. In this case however, the pin count of the ASIC is handler 320 via signal line 333, as described below in 

increased in accordance with the number of parallel signal conjunction with FIG. 15. 

lines connected between the external deserializer and the The frame handler 320 includes much of the same cir- 

ASIC and between the external serializer and the ASIC. 65 cuitry as the illustrative, single channel port 38 shown in 

The receiver portion of the receiver and transmitter cir- FIG. 3, such as a local memory 380, a Local Memory 

cuits 314,-314* includes, in addition to the deserializer Manager 382, a Frame Preprocessor 384, a Receive Frame 
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manager 386, a Receive cache 3MJ, a DMA 390, a TYansmit 
Frame manager 392, a Transmit cache 394 and the System 
Interface 328, Also included in the frame handler 320 are a 
Write Data FIFO 396 and a Read Data FIFO 398 associated 
with the Receive cache 388, a Write Data FIFO 400 and a 
Read Data FIFO 402 associated with the DMA 390, and a 
local memory Write Data FIFO 406 and Read Data FIFO 
408, as shown. The circuitry of the frame handler 320 
operates in substantially the same manner discussed above 
in conjunction with FIG. 3. However, whereas the Frame 
preprocessor 120 of FIG. 3 is responsive to frame headers 
from the single Frame Header FIFO 114, the Frame prepro- 
cessor 384 is responsive to frame headers from the plurality 
of Frame Header FIFOs 352 r 352 w forwarded to the Frame 
preprocessor 384 by the frame prioritization circuit 330. 

More particularly, a frame header forwarded to the frame 
handler 320 by the frame prioritization circuit 330, is 
specifically forwarded to the Frame preprocessor 384. Hie 
Frame preprocessor 384 checks the CRC field 58 (FIG. 2A) 
of the received frame header to determine whether or not the 
frame will be discarded if the frame was not accurately 
received, maintains error counters, and deterrnines whether 
the destination node specified in the header field 76 of the 
received frame matches that of the receiving port, as 
described above. After processing a received frame header, 
the Frame preprocessor 384 forwards the frame header to the 
Receive Frame Manager 386. 

The Receive Frame Manager 386 is described above and 
shown in FIG. 4 and controls the transfer of received frame 
data 56 from the local memory 380 to the system memory 
associated with each node client system by programming the 
DMA 390 to move data 56 out of the local memory 380 and 
transfer such data to the system memory in response to 
receipt of the respective frame header 54 by the Receive 
Frame Manager 386. The DMA 390 achieves this transfer of 
data 56 via Write Data FIFO 400, Read Data FIFO 402, the 
Local Memory Manager 382, and the System Interface 328. 

The Transmit Frame Manager 392 programs the DMA 
390 to read data 56 out of the system memory and forward 
the data, along with a corresponding header, to the frame 
routing circuit 340 in response to a request from a node 
client. The header for transmission to the destination node 
may be generated by the Transmit Frame Manager 392 or, 
alternatively, may be provided directly by the host computer 
306 or other node client. 

The Receive cache 388 is provided in communication 
with the Receive Frame Manager 386 and the Local 
Memory Manager 382 via the Write Data FIFO 396 and the 
Read Data FIFO 398 and stores a context associated with 
each packet processed by the node 300, as described above 
in conjunction with FIGS. 4 and 5. When a frame header is 
received by the Receive Frame Manager 386, it is deter- 
mined whether the class of transmission service requires that 
an acknowledgement signal be returned to the source node. 
In the event that an acknowledgement signal is required, the 
control state machine of the Receive Frame Manager 386 
(labelled 174 in FIG. 4) generates the acknowledgement 
signal and forwards such acknowledgement signal to the 
Transmit Frame Manager 392. The receive sequence state 
machine of the Receive Frame Manager 384 (labelled 170 in 
FIG. 4) generates a tag associated with a received frame 
header for comparison to contexts stored in the Receive 
cache 388. If the generated tag matches one stored in the 
Receive cache 388, then the contents of the matching 
context are loaded from the cache 388 into the current 
context of the Receive Frame Manager (labelled 178 in FIG. 
4). Alternatively, if the generated tag does not match a 
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context stored in the Receive cache 388, then the receive 
sequence state machine 170 receives initialized contents for 
the current context 178 from the node client associated with 
the port on which the processed frame was received. Simi- 
larly, the Transmit cache 394 is provided in communication 
with the Transmit Frame Manager 392 and the Local 
Memory Manager 382 via the Write Data FIFO 406 and the 
Read Data FIFO 408, as shown. The Transmit cache 394 
functions in a manner similar to the Receive cache 388, 
albeit in the transmission of frames as opposed to the receipt 
of frames. 

In response to a request by a node client 306, 308, 310, 
frames are processed by the frame handler 320 and are 
forwarded to the frame routing circuit 340 for transmission 
to other nodes of the fabric 10. More particularly, the 
processed frame is provided to the frame routing circuit 340 
via signal line 338. The frame routing circuit 340 routes 
processed frames to a port 304 x -304^ for transmission to one 
or more destination nodes via the switch fabric 10, in a 
manner described further in conjunction with FIG. 16. 

The transmitter portion of each receiver and transmitter 
circuit 314 r 314 w (i.e., the circuitry included in the Frame 
Transmitter 146 of FIG. 3) includes an encoder 370 r 370„, 
a PSG circuit 372 r 372^ a Frame Transmit circuit 376 r 
376/v, and a Frame Transmit FIFO 3541-354^. Considering 
illustrative port 304j, the Frame Transmit circuit 376 x con- 
tains logic for assembling Fibre Channel frames based on 
the frames stored in the Frame Transmit FIFO 354j, for 
calculating the CRC and for signalling the PSG circuit 372j 
to transmit idles between frames of a packet (see FIG. 2A). 
Hie PSG circuit 372j generates the appropriate primitive 
sequences for transmission on the respective channel 304! 
and inserts idles under the command of the Frame Transmit 
circuit 376 v The encoder 370 1 generates ten-bit transmis- 
sion characters for transmission over the switch fabric 10. 

Referring also to FIG. 15, a block diagram of the frame 
prioritization circuit 330 is shown. The frame prioritization 
circuit 330 includes a switch 430 having a plurality of input 
terminals 432,-432^ and an output terminal 434. The switch 
430 is adapted for being in one of "N" positions in which the 
output terminal 434 is connected to a respective one of the 
"N" input tenninals 432r434;v. Also provided in the frame 
prioritization circuit 330 is a control circuit 438 for control- 
ling the position of the switch 430. 

The control circuit 438 implements one or more of the , 
port prioritization schemes described above for selecting a 
frame header received by one of the ports 304j-3O4 N to be 
forwarded to the frame handler 320 for processing of the 
respective frame. In one such prioritization scheme, each 
port 304! -304^ has a predetermined priority assigned 
thereto at system initialization. The priority assigned to each 
port 304 r 304jy may be based on various criteria, such as the 
type of node client associated with the port or the signal 
processing rate thereof or the anticipated frame traffic on the 
port. For example, it may be advantageous to assign a higher 
priority to the port 304 1 associated with the host computer 
306 than to the port 304 2 associated with the data storage 
device 308. 

A port identifier and the respective port priority are stored 
in a memory portion of the control circuit 438 for use in 
selecting a received frame header for forwarding to the 
frame handler 320. With this arrangement, the control circuit 
438 polls the Frame Header FIFO 352 t -352 N associated with 
each port 304 } -304^ in the order of priority assigned to the 
respective port 304, -304^, For example, consider the case 
where node 300 includes ports 304 lt 304 2 , and 304^ where 
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N=3, as shown in FIG. 12, and port 304, is assigned the 
highest priority, port 304 3 is assigned the second highest 
priority and port 304 2 is assigned the lowest priority. The 
control circuit 438 initially positions switch 430 to connect 
input terminal 432, to output terminal 434. With switch 430 5 
in this position, one or more frame headers stored in Frame 
Header FIFO 352, are forwarded to the frame handler 320. 
Thereafter, control circuit 438 toggles switch 430 to a 
second position, in which input terminal 432 3 is connected 
to the output terminal 434 for forwarding one or more frame 
headers in FIFO 3523 to frame handler 320. Finally, control 
circuit 438 causes switch 430 to move to a third position in 
which input terminal 4322 is connected to output terminal 
434 in order to forward one or more frame headers stored in 
Frame Header FIFO 352j to frame handler 320. This process 
of polling the Frame Header FIFOs 352,-352^ associated 15 
with each port 304,-304^ in ascending order of the priority 
assigned to the respective port continues until the port 
having the lowest priority is polled, following which the 
process is repeated Note that all of the frame headers stored 
in a polled Frame Header FIFO 352,-352^ may be for- 
warded to the frame handler 320 sequentially, so as to empty 
a selected FIFO each time the FIFO is connected to the 
frame handler 320 via switch 430 or, alternatively, only one, 
or another selected number, of frame headers thus stored 
may be forwarded each time a FIFO 352,-352^ is connected 25 
to the frame handler 320 via switch 430. 

In accordance with another prioritization scheme, the 
ports 304,-304^ are accessed for forwarding stored frame 
headers in accordance with a predetermined order of ports 3Q 
304, -304^. One such predetermined order is a "round robin" 
scheme, in which the ports are polled in accordance with the 
sequence of the ports 304 ,-304^ such that one or more 
frame headers received by port 304, are transferred to the 
frame handler 320, followed by one or more frame headers 35 
received by port 304 2 , etc. 

Another predetermined port order is based on the order in 
which frames are received at each port 304 r 304 w . In 
accordance with this prioritization scheme, the Frame 
Header FIFOs 352,-352^ send empty/not empty signals on 40 
signal line 356,-356^ to the frame prioritization circuit 330 
indicative of whether a frame header has been received by 
the respective FIFO 352,-352^ This prioritization scheme 
operates on an interrupt basis in that, once an empty/not 
empty signal is received by the frame prioritization circuit 45 
330 indicating that a frame header has been received, the 
frame prioritization circuit accesses that FIFO and transfers 
the received frame, or frames to the frame handler 320. In 
the case where more than one of the Frame Header FIFOs 
352 , -352^ receives frames substantially simultaneously, 5 o 
causing the frame prioritization circuit 330 to receive more 
than one not empty signal substantially simultaneously, then 
the FIFOs thus receiving frames are polled in a round robin 
fashion. 

In accordance with an adaptive port prioritization scheme, 55 
the control circuit 438 positions switch 430 in accordance 
with the number of frame headers currently stored in the 
Frame Header FIFO 352,-352^ associated with each port 
304,-304^ More particularly, in one embodiment, each 
Frame Header FIFO 352,-352^ sends a level indication 60 
signal on respective signal line 356,-356^ to the control 
circuit 438 indicative of how much data is currently stored 
in the FIFO 352,-352^ The control circuit 438 determines 
which FIFO 352,-352^ has the most headers stored therein 
in response to the level indication signals and polls the 65 
FIFOs 352! -354^ in descending order of the number of 
headers stored. 



At system initialization, each port 304,-304^ communi- 
cates to every other port connected to the fabric 10 infor- 
mation regarding the capacity of the respective Frame 
Header FIFO 352,-352* and Frame Data FIFO 350,-350^. 
In a Fibre Channel network, this communication is referred 
to as "login" and includes parameters such as how many 
frames a particular port can accept (i.e., the "credit"), the 
length of frame data that the port can accept, and the class 
of Fibre Channel service supported by the port, as described 
in the above-referenced Fibre Channel (FC-PH) specifica- 
tion. In operation, a transmitting, or source node uses the 
information about other nodes received during the initial- 
ization procedure to avoid overrunning the Frame Header 
FIFO and Frame Data FIFO of a destination node. 

With the use of the shared node 300, the credit specified 
by a port at system initialization can be manipulated in 
accordance with the frame prioritization scheme employed 
by the frame prioritization circuit 330. More particularly, 
even though the Frame Header FIFO 352 r 352 N associated 
with each port 304,-304^ has a fixed size, the credit can 
indicate that greater than actual buffer capacity is available 
if the frame prioritization scheme is tailored to ensure that 
the frames received at that particular port are rapidly for- 
warded to the frame handler 320, With this arrangement, a 
port can accommodate a higher frame traffic level than 
otherwise permissible by tailoring the frame prioritization 
scheme to provide the port with a higher rate of forwarding 
frames received by that port to the frame handler 320. 

Referring also to FIG. 16, the frame routing circuit 340 
includes a control circuit 450 which receives processed 
frames from the DMA 390 and Transmit Frame Manager 
392 of the frame handler 320 via signal line 338 (FIGS. 14 
and 14A). The control circuit 450 may include a buffer for 
storing frames received on line 338. TTic control circuit 450 
includes a look-up table 454 which contains a list of desti- 
nation node identifiers (Le., the D_ID field 76 of the 
illustrative frame header 54 of FIG. 2B) for each node 
known to be connected to the switch fabric 10 and an 
identifier of a corresponding port 304, -304^ of the shared 
node 300 on which a frame can be transmitted to each listed 
destination node. A switch 458 is provided with an input 
terminal 460 and a plurality of output terminals 462,-462^, 
each one corresponding to one of the ports 304,-304^ of the 
shared node 300. Switch 458 is adapted for being in one of 
"N" positions, in which the input terminal 460 is connected 
to a respective one of the output terminals 462 1 -462 Ar to 
route a processed frame from the frame handler 320 to one 
or more ports 304,-304^ for transmission to one or more 
destination nodes. 

In operation, when the control circuit 450 receives a . 
processed frame on line 336 (i.e., either a data frame or an 
acknowledgement signal), the destination node identifier 
D_ID specified in the processed frame is located in the table 
454. An identifier of the port 304, -304^ associated with the 
located D_JD table entry is read from the table 454 and the 
control circuit 450 positions switch 458 accordingly. That is, 
circuit 450 positions switch 458 to connect the input termi- 
nal 460 to the output terminal 462,-462^ associated with the 
port 304 r 304 Ar on which the processed frame is to be 
transmitted. In this way, the frame routing circuit 340 
operates as a demultiplexer to connect the processed frame 
or acknowledgement signal at the input terminal 460 to at 
least one of the output terminals 462,-462^ Note that in 
broadcasted transmissions (i.e., transmission to more than 
one destination node), a processed frame may be transferred 
to multiple switch output terminals 462,-462^ for transmis- 
sion to multiple destination nodes via respective ports 304,- 
304^ 
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The shared node configuration described above in con- 
junction with FIGS. 12-16 is advantageous for several 
reasons. First, by sharing resources among multiple network 
channels 302 r 302 w , the cost of providing a node is reduced, 
as compared to the use of a dedicated port/node for each 5 
network channel, particularly when advanced processing 
technology, such as the preferred 0.35 micron technology, is 
used to fabricate the node 300. Additionally, the required 
circuit board surface area occupied by each node is reduced 
by use of the shared node 300, since disadvantageous circuit 
redundancy otherwise required is avoided. Furthermore, full 
utilization of resources shared among multiple ports, such as 
local memory, further reduces the effective cost of such 
shared resources to each port 

Additionally, the shared node 300 permits simultaneous 
processing of a frame and receipt of frames at the ports 15 
304J-304JV, thereby providing dynamic resource sharing. 
That is, as opposed to rendering one port busy when a frame 
received by another port is being processed, the shared node 
300 permits dynamic receipt of frames by multiple ports 
304,-304^ when a frame is being processed by the frame 20 
handler 320. 

Significantly, the shared node configuration permits 
enhanced node performance by permitting port frame traffic 
capability to be manipulated. That is, by tailoring the port 
prioritization scheme employed by frame prioritization cir- 25 
cuit 330 to favor a particular port 304 r 304^, that port can 
be permitted to accommodate a higher frame traffic level 
than otherwise permissible. 

While the node in the illustrative embodiments is fabri- 
cated in the form of an ASIC, it will be appreciated that the 30 
circuitry may be fabricated on multiple ASICs or other 
utilizing other suitable circuit devices to implement the 
presently disclosed subject matter. 

Having described the preferred embodiments, those 35 
skilled in the art will realize that many variations are 
possible which will still be within the scope and spirit of the 
claimed invention. Therefore, it is the intention to limit the 
invention only as indicated by the scope of the claims. 

We claim: 

40 

1. A communications network for transmitting frames 
between nodes connected to the network, said network 
comprising: 

(a) at least one node comprising: 

(i) a plurality of ports capable of receiving frames from 45 
another node connected to said network substantially 
simultaneously and transmitting frames to another 
node connected to said network; 

(ii) a frame handler for processing said frames received 
by said plurality of ports; 50 

(iii) a multiplexer for forwarding a first frame received 
by a selected one of said ports to said frame handler; 
and 

(iv) a demultiplexer for routing a second frame from 
said frame handler to at least a selected one of said S5 
plurality of ports; and 

(b) a plurality of node clients in communication with said 
least one node, wherein each one of said node clients is 
associated with a corresponding one of said plurality of 
ports. 60 

2. The communications network recited in claim 1 
wherein said frame handler comprises a memory and a 
system interface for permitting communication between said 
frame handler and said plurality of node clients via a system 
bus. 65 

3. The communications network recited in claim 1 
wherein said node further comprises a plurality of receiver 



and transmitter circuits, each one connected to a respective 
one of said plurality of ports. 

4. The communications network recited in claim 1 
wherein said multiplexer comprises a control circuit for 
selecting said first frame in accordance with a priority 
assigned to each of said plurality of ports, wherein a first one 
of said plurality of ports is assigned a highest priority and a 
second one of said plurality of ports is assigned a lowest 
priority. 

5. The communications network recited in claim 1 
wherein said multiplexer comprises a control circuit for 
selecting said first frame in accordance with a predetermined 
order of said plurality of ports. 

6. The communications network recited in claim 1 
wherein each of said frames received by said plurality of 
ports comprises a header and data and wherein said at least 
one node further comprises a plurality of frame header 
buffers, each one corresponding to a respective one of said 
plurality of ports, for storing the header of frames received 
by said respective ports. 

7. The communications network recited in claim 6 
wherein said multiplexer comprises a control circuit for 
selecting said first frame in accordance with the number of 
frame headers stored in each of said plurality of frame 
header buffers. 

8. The communications network recited in claim 1 
wherein said demultiplexer comprises a control circuit 
responsive to said second frame and a look-up table for 
determining a destination node specified in the header of 
said second frame and for routing said second frame to at 
least one of said plurality of ports associated with said 
destination node. 

9. The communications network recited in claim 1 
wherein each of said plurality of node clients is one of a host 
computer, a data storage device, and a network interface. 

10. The communications network recited in claim 4 
wherein said first one of said plurality of ports assigned the 
highest priority provides a credit to other nodes connected to 
said communications network indicating a number of frames 
that said first one of said plurality of ports is capable of 
receiving, wherein said indicated number of frames is 
greater than a number of frames that said respective frame 
header buffer is capable of storing. 

11. A node for use in a communications network having 
a plurality of channels, said network permitting transmission 
of frames including a header between said node and another 
node connected. to said network, said node comprising: 

a plurality of ports, each one associated with a respective 
one of said plurality of channels of said communica- 
tions network; 

a plurality of frame header buffers, each one associated 
with a respective one of said plurality of ports, for 
storing the header of frames received by said respective 
port; 

a multiplexer for selecting a first frame stored in a one of 
said plurality of frame header buffers to be processed; 
a frame handler for processing said first frame; and 
a demultiplexer for routing a second frame designated for 
transmission to at least a selected one of said plurality 
of ports for transmission to said other node connected 
to said network. 

12. The node recited in claim 11 further comprising a 
plurality of frame transmit buffers, each one associated with 
a respective one of said plurality of ports, for temporarily 
storing said second frame prior to transmission by said 
respective port, wherein said demultiplexer routes said sec- 
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ond frame to the respective frame transmit buffer associated 
with said selected port. 

13. The node recited in claim 11 wherein said frame 
handler comprises a memory and a system interface for 
permitting communication between said frame handler and 5 
a plurality of node clients. 

14. The node recited in claim 11 further comprising a 
plurality of receiver and transmitter circuits, each one asso- 
ciated with a respective one of said ports and being con- 
nected between said respective port and the respective frame io 
header buffer 

15. The node recited in claim 11 wherein said multiplexer 
comprises a control circuit for selecting said first frame in 
accordance with a predetermined priority assigned to said 
plurality of ports. is 

16. The node recited in claim 11 wherein said multiplexer 
comprises a control circuit for selecting said first frame in 
accordance with a predetermined order of said plurality of 
ports. 

17. The node recited in claim 11 wherein said multiplexer 20 
comprises a control circuit for selecting said first frame in 
accordance with the number of frame headers stored in each 

of said plurality of frame header buffers, 

18. The node recited in claim 11 wherein said demulti- 
plexer comprises a control circuit responsive to said second 25 
frame and a look-up table, for determining at least one of 
said plurality of ports associated with a destination node 
specified in said second frame and for routing said second 
frame to said at least one port. 

19. A method for processing frames received by a node of 30 
a communications network, comprising the steps of: 

receiving frames at a plurality of ports of said node, said 
ports being capable of receiving said frames substan- 
tially simultaneously with respect to one another; 
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selecting a first frame received by one of said plurality of 
ports for forwarding said first frame to a frame handler 
of said node for processing; and 

routing a second frame designated for transmission to a 
destination node by said node to at least one of said 
plurality of ports associated with said destination node. 

20. The method recited in claim 19 wherein said frame 
selecting step comprises the steps of: 

assigning a priority to each of said plurality of ports based 

on a predetermined criteria; and 
selecting said first frame in accordance with a descending 

order of port priority. 

21. The method recited in claim 19 wherein said frame 
selecting step comprises the step of selecting said first frame 
in accordance with a predetermined order of said plurality of 
ports. 

22. The method recited in claim 19 wherein said frame 
selecting step comprises the steps of: 

determining the number of frames received at each of said 

plurality of ports; and 
selecting said first frame In accordance with a descending 

order of the number of frames received by each of said 

plurality of ports. 

23. Hie method recited in claim 19 wherein said frame 
routing step comprises the steps of: 

determining a destination node identity specified by a 

header portion of said second frame; 
accessing a look-up table to determine at least one of said 

plurality of ports associated with said destination node; 

and 

routing said second frame to said at least one port. 
* * * * * 
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